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(54) Auditory sense training method and sound processing method for auditory sense training 



(57) An auditory sense training device 1 to be used 
in an auditory sense training method for training auditory 
sense by listening to a sound formed by processing an 
original sound comprises a band attenuation processing 
method 20 for attenuating a predetermined frequency 
band of an original sound 10, a switching means 30 for 
selectively outputting either the original sound or the 
output from said band attenuation processing means, a 
panpot processing means 40 for performing a panpot 



process wherein a voice signal formed by attenuating 
an original sound of one channel is superposed to the 
original sound of another channel, and a phase reverse 
processing means 50 for performing a phase reverse 
process of reversing the phase of the original sound, 
wherein a trainee listens to the original sound and a 
band attenuation processed sound formed by attenuat- 
ing a predetermined frequency band of the original 
sound alternately. 
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Description 

BACKGROUND OF THE INVENTION 

[0001] The present invention relates to an auditory 
sense training method and sound processing method 
for auditory sense training which realizes an effective 
training for the great improvement of auditory percep- 
tion, which is an obstacle to a person grown in an envi- 
ronment having a different language practice from learn- 
ing another language or music of a different language 
environment. 

[0002] Further, the present invention relates to an au- 
ditory sense training method and sound processing 
method for auditory sense training which may be used 
in medical areas such as the treatment for hypacusia 
and tinnitus, or music treatment. 

[Regarding auditory sense] 

[0003] The auditory sense of a person does not have 
a structure common to everyone, but rather, the struc- 
ture of the auditory sense could be characterized by the 
language the person is using in their daily life. In other 
words, the structure of a person's auditory sense is ad- 
vanced so that it works conveniently when listening to 
the language they use in their daily life. 
[0004] In this specification, the structure of an audito- 
ry sense refers to the structure including the recognition 
ability of a-vowel or a consonant, or the recognition abil- 
ity of the attenuation of a tone and the like. 
[0005] It is very rare in the Japanese language to end 
a word or a sentence by a consonant including many 
high frequency components of above 200 Hz for exam- 
ple. Rather, it ends by attenuating a vowel including 
many low frequency components. 
[0006] Further, according to studies, it is now known 
that the Japanese especially sensitively percepts a vow- 
el in a voice, and as a very special phenomenon, the 
Japanese are very sensitive to the reverbaration includ- 
ed in a vowel (reverbaration is likely to remain when the 
frequency is low) . 

[0007] These characteristics on the frequency band 
of the Japanese language and the sensitiveness of the 
Japanese native to the reverbaration sound or the at- 
tenuation sound show that the Japanese have a tenden- 
cy to concentrate on the sound in the ending of a word. 
[0008] That is, to a Japanese user, a peculiar or 
unique auditory sense structure which is appropriate for 
listening to and speaking Japanese is formed. There- 
fore, a voice which falls out of the peculiar auditory 
sense structure, for example, with a frequency compo- 
nent of above 2000Hz, could not be recognized easily, 
and there is a tendency that the language having differ- 
ent pronunciation forms or grammar structure is hard to 
recognize. 

[0009] Moreover, aging is another cause which 
makes it difficult for a person to recognize voice having 



high frequency regions. 

[0010] On the other hand, in European languages 
such as English, German and Latin, high frequency 
components of over 2000 Hz are largely included, and 

5 some components even reach up to 6000 Hz. 

[0011] That is, the language characteristics of an Eu- 
ropean language is opposite to Japanese in that the 
vowels only hold a dependent meaning, and that the rec- 
ognition of the energy, the rising condition and the depth 

io included in a consonant or the way to cut the consonant 
in the ending of a word is most important in recognizing 
the language. Moreover, the intonation, the strength, the 
accent and the like related to the grammar is important 
in recognizing the language. This could also be recog- 

15 nized from the fact that the native European language 
speakers are able to recognize the conversation of their 
language even by listening to voices whose frequency 
components of under 2000 Hz are reduced. 
[0012] From the above mentioned fact, it could be 

20 seen that the Japanese have a tendency to recognize 
a vowel which does not exist, but on the other hand, may 
not recognize an existing consonant. 
[001 3] For example, the Japanese are known to have 
a low ability to recognize the rising of a consonant or to 

25 tell the high frequency components in a sound. One 
known example is that the Japanese have a low ability 
to tell the difference between the consonant of "L° and 
"R" or "M" and "N" in English. 

[0014] Further, they recognize the word "McDonald" 
30 as "makudonarudo", and "Seven Eleven" as "sebun ire- 
bun", and pronounce such words by adding vowels. 
[0015] That is, the above-mentioned words pro- 
nounced by the Japanese speaker is constituted ac- 
cording to the auditory sense structure of the Japanese 
35 language. 

[001 6] If the ability to recognize the rising of a conso- 
nant or to tell the high frequency components in a sound 
is low, the ability to pronounce the rising of a consonant 
or the high frequency components in a sound is also 
40 very low. 

[0017] Therefore, according to the Japanese auditory 
sense structure mentioned above, it is difficult to either 
hear the language having a different language practice 
accurately or to pronounce such language as the native 

45 speakers. 

[0018] In order to understand the structure of the au- 
ditory sense according to the Japanese language, the 
inventor performed an experiment where native Japa- 
nese speakers listened repeatedly to a voice processed 

50 to reduce its low frequency components and to strength- 
en a specific frequency band component, and came to 
the following conclusion. 

[0019] Moreover, as a result of continuous experi- 
ment, a data was gained where the auditory sense 
55 would quickly switch back to the auditory structure as a 
Japanese native speaker when an unprocessed lan- 
guage is heard instead of the processed language. 
[0020] Accordingly, it could be understood that in the 
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auditory sense structure, the "recognition frequency" 
differs according to national, in other words, an "unrec- 
ognized frequency" exists according to national even if 
their tympanum may vibrate. 

[0021] It is a problem yet to be solved in this unrec- 
ognized voice to find out what ability to recognize which 
frequency region is low and what training could there be 
to raise the ability to recognize those frequency region. 
[0022] The characteristics of the language was men- 
tioned above, but on the other hand, another unexpect- 
ed fact was recognized by considering the characteris- 
tics regarding "conversation". 

[0023] The conversation involves not only listening to 
the meaning of the contents of the speaker's words, but 
the listener also tries to decide his or her correspond- 
ence by constantly anticipating the words of the speaker 
from its contents. This anticipation is not only performed 
based on the meaning of the words itself, but also by 
the listener listening to the language and feeling the del- 
icate nuance of the attitude, the tone, the flow of breath, 
the expression on the face of the speaker and the like, 
and to decide based on the impression from the speak- 
er. This anticipation involves the experience, the knowl- 
edge, the insight and the like of the listener. 
[0024] Therefore, conversation is performed by re- 
sponding to the speaker through anticipation of the con- 
versation based on the feelings received from the 
speaker, other than the meaning that the words hold. 
Such element of the conversation other than the pure 
language is considered to even exceed 60% of the 
whole information. 

[0025] As mentioned above, the ability to try and rec- 
ognize in their mind the frequency component included 
in a voice which is unique to the language (which is 
called "perception frequency" in the specification) varies 
according to each national. Such difference of the rec- 
ognizable frequency band between the national is not 
caused by the difference in the structure of the auditory 
organ, but by the difference in the consciousness of the 
listener. 

[0026] Since the listener lacks large elements other 
than language in a conversation and lacks the auditory 
sense formed by the language practice when having a 
conversation in a foreign language, there may be 
caused a difference in the understanding of the speaker 
and the listener caused by the difference of the lan- 
guage environment or the culture, which may lead to 
misunderstanding or even a panic. 
[0027] Therefore, in order to accurately listen to a for- 
eign language and to acquire the language, there is a 
need to break the auditory sense structure constituted 
from the practice or the anticipation of one's mother 
tongue. Therefore, an effective means for learning lan- 
guage is to process by some method the sound itself of 
the language to learn. 



[Regarding music] 

[0028] On the other hand, music, like scat and sing- 
ing, could be recognized as an objective element of a 

5 language, and holds a characteristic as a developed 
state of a language, which means that music may com- 
prise more subjective impressions or imaginations than 
the language itself. Therefore, in order to practice for- 
eign music, such as westernmusic, it is expected to be 

10 effective to break the auditory sense structure formed 
by the environment of different language practice, and 
to stop the thinking based on the Japanese language. 

[Regarding conventional training methods] 

15 

[0029] In the training of acquiring hearing skills for a 
foreign language, most of the prior art methods utilized 
media such as CD or a face-to-face method where the 
trainee listens repeatedly to the pronunciation of a na- 

20 tive speaker in order to lean a native pronunciation. 
[0030] Moreover, a method for improving the effect is 
further proposed where the hearing training is per- 
formed by using media comprising images which direct- 
ly appeal to the sense of sight of the trainee. 

25 [0031] Further, accompanied by the development of 
personal computers, there is also provided computer 
softwares which could be used like games where the 
trainee decides on a story, and hits the keys on the com- 
puter following the spelling displayed on the monitor in 

30 order to learn foreign words. 

[0032] Moreover, there are methods of training where 
an English word which is difficult to hear is played back 
in slow-motion as disclosed in Japanese Patent Publi- 
cation No. S60-1 59776, a device for emphasizing the 

35 pronunciation comprising a frequency that is hard to 
hear from the trainee as disclosed in Japanese Utility- 
Model Publication No. 30003950, a device for activating 
the brain by outputting English to either one of the left 
or right channels and outputting music to the other chan- 

40 nel as disclosed in Japanese Patent Laid-Open Publi- 
cation No. H2-1 96272, or a method for either repeatedly 
outputting a frequency-processed English or by mixing 
English into music as disclosed in Japanese Patent 
Laid-Open Publication No. H6-67596. 

45 [0033] Moreover, a device for taking out the difficult- 
to-hear frequency region and to amplify that tone so as 
to compensate for the lack of auditory capacity in an au- 
ditory sense handicapped person is disclosed in Japa- 
nese Patent Laid-Open Publication No. S48-98698. 

so [0034] On the other hand, there were many methods 
from old times to learn a language with the rhythm of a 
percussion instrument or other music. 
[0035] As a new technology, there is a unique method 
being invented where the foreign language is learned 

55 generally by image training accompanied by figures, 
music or the movement of the body. 
[0036] In present years, most of the method for learn- 
ing language is performed by listening to a language 
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spoken by a native speaker or foreign lecturer, combin- 
ing a method to improve the learning effect by various 
ideas. 

[0037] However, those ideas which may seem unique 
does not fall out of the basic leaning method of repeating 
and experiencing. 

[0038] For example, in the method where the trainee 
listens to music or synthetic sound or pulse which have 
been frequency-processed so as to simplify the listening 
of foreign language, the trainee merely gets used to the 
high frequency wave temporarily, which is the same as 
feeling an afterimage when seeing light in the dark. As 
a result of investigation, such result is not permanent, 
and not very effective as a training method. 
[0039] It is true that high frequency is included in the 
western language such as English, but according to the 
studies by the inventor, the auditory sense is not so sim- 
ple as recognizing a foreign language by merely listen- 
ing and getting used to high frequency. 
[0040] That is because listening to high frequency and 
recognizing a sound holds absolutely different prob- 
lems. 

[0041] Further, as for the amplifying device for com- 
pensating the lack of auditory capacity of an auditory 
sense handicapped person, it is performed against a pa- 
tient who lacks normal auditory sense, and is a device 
for merely selectively compensating the lacked frequen- 
cy band. 

[0042] The difference between the prior art methods 
and the present invention will become apparent from the 
motivation and the object of the present invention dis- 
closed hereinafter. 

[0043] The above-mentioned prior art merely 
strengthens the frequency component included in the 
voice portion which is difficult to catch in learning a for- 
eign language, and to temporarily improve the listening 
skill. Therefore, the auditory sense of the trainee will re- 
turn to its normal status when the trainee listens to his 
or her mother tongue. Since the effect by such prior art 
method is not permanent, the training will need a long 
period of time for repeated training. 
[0044] It is known that it is very effective in the learning 
of language to change the perception frequency. There- 
fore, it is necessary for the trainee to break off the an- 
ticipation and the like when speaking the mother tongue 
or the practice in everyday life. 

[0045] The ability to catch a foreign language is not 
only a problem of different frequency, but there is also 
a need to consider the following points. 

1) The problem of aging where the high frequency 
region becomes hard to catch by aging. 

2) The actual frequency band that the Japanese feel 
difficulty in catching, and the training method for 
catching that high frequency is still not known. 

3) Language should be understood by catching 
more generally the rhythm, flow, intonation, timing 
and language practice difference between languag- 



es. 

SUMMARY OF THE INVENTION 

5 [0046] By the consideration on the above mentioned 
problems, the present invention aims at providing an au- 
ditory sense training method, a sound processing meth- 
od for auditory sense training, auditory sense training 
device, and a recording media for auditory sense train- 

10 ing which records the processed sound for auditory 
sense training, which greatly improves the effect of lan- 
guage learning by specifying the effective frequency 
band for changing the perception frequency and to 
break off the practice of the mother language and antic- 

15 ipation. 

[0047] In order to solve the above-mentioned prob- 
lem, the present invention provides an auditory sense 
training method for training auditory sense by listening 
to a sound made by processing an original sound, where 

20 a trainee listens to a region attenuation processed 
sound which is formed by attenuating a predetermined 
frequency region of said original sound. 
[0048] Further, the present invention provides an au- 
ditory sense training method mentioned above where 

25 the trainee either listens continuously to the region at- 
tenuation processed sound which is formed by attenu- 
ating a predetermined frequency region against said 
original sound, or listens to said region attenuation proc- 
essed sound and the original sound alternately, or lis- 

30 tens to said region attenuation processed sound and an 
unacoustic (silence) portion alternately, or listens to said 
region attenuation processed sound, said original sound 
and said unacoustic sound alternately. 
[0049] Moreover, the original sound to be heard alter- 

35 nately with the region attenuation processed sound may 
be an original sound which differs from the original 
sound being processed by the region attenuation proc- 
ess. 

[0050] The present auditory sense training method 
40 sets the region for performing the attenuation process 
to the original sound in a region below a predetermined 
frequency in the range between 1800 Hz and 7000Hz. 
[0051] Further, the method sets the region for per- 
forming the attenuation process to the original sound in 
45 the region above a predetermined frequency in the 
range between 2000 Hz and 7000 Hz. 
[0052] Moreover, the present invention sets the re- 
gion for performing the attenuation process to the orig- 
inal sound in two regions; a region below a predeter- 
so mined frequency between 1 800 Hz and 7000 Hz, and a 
region over a predetermined frequency between 2000 
Hz and 7000 Hz. 

[0053] Even further, the auditory sense training meth- 
od according to the present invention is performed by 
55 selecting one of the above plurality of region attenuation 
processes and performing the process to a plurality of 
frequencies. Further, the auditory sense training method 
according to the present invention is performed by com- 
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bining two or more region attenuation processes men- 
tioned above. 

[0054] According to the auditory sense training meth- 
od of the present invention, the region attenuation proc- 
ess is performed to a plurality of various frequencies, s 
and the frequency and the process time is randomly set 
and arranged in time order. 

[0055] In order to solve the above-mentioned prob- 
lems, the present invention provides an auditory sense 
training method for training auditory sense by listening 10 
to a sound of more than two channels processing the 
original sound, wherein the trainee listens to a panpot 
processed sound performed of a process wherein an 
amplitude of the original sound of one channel is atten- 
uated to form an amplitude attenuation processed "is 
sound which is outputted to one channel, and the am- 
plitude attenuation processed sound formed by attenu- 
ating the amplitude of the original sound of one channel 
is superposed to the original sound of the other channel 
and outputted to the other channel (this process here- 20 
inafter called a panpot process) and a sound which has 
not been performed of said panpot process alternately. 
[0056] According to the present invention regarding 
an auditory sense training method performing the 
above-mentioned panpot process, said panpot process 25 
is performed so that the sum of the amplitude attenua- 
tion processed sound outputted to one channel and the 
amplitude attenuation processed sound outputted to the 
other channel is fixed for one channel signal. 
[0057] According to the present invention regarding 30 
an auditory sense training method performing said pan- 
pot process, the panpot process is performed by a plu- 
rality of various process patterns, wherein the process 
pattern and the process time is set randomly and the 
panpot process is arranged in time order. 35 
[0058] In order to solve the above-mentioned prob- 
lem, the present invention provides an auditory sense 
training method for training auditory sense by listening 
to a sound processing an original sound, wherein a train- 
ee listens to a phase reverse processed sound per- 40 
formed of a phase reverse process to the original sound 
and the original sound alternately. 
[0059] According to the present invention regarding 
an auditory sense training method using said phase re- 
verse process, said phase reverse process sets the 45 
processing time randomly and the process is arranged 
in time order. 

[0060] In order to solve the above-mentioned prob- 
lem, the present invention regarding an auditory sense 
training method combines said region attenuation proc- so 
ess and said panpot process. 

[0061] Moreover, the auditory sense training method 
of the present invention combines said region attenua- 
tion process and said phase reverse process. 
[0062] Further, the auditory sense training method of 5s 
the present invention combines said panpot process 
and said phase reverse process. 
[0063] Moreover, the prevent invention combines said 



region attenuation process, said panpot process and 
said phase reverse process. 

[0064] The auditory sense training method of the 
present invention defines said original sound to one of 
the following; either natural sound or artificial sound, ei- 
ther voice or non-voice, or either tone or noise. 
[0065] The auditory sense training method of the 
present invention defines said original sound to two or 
more of either natural sound or artificial sound, either 
voice or non-voice or either tone or noise. 
[0066] Natural sound includes all sound except for the 
sound generated artificially. Voice includes all the voice 
generated by a human, and non-voice includes all 
sounds except voice. Tone includes every sound except 
noise, and noise includes all sound other than tone. 
[0067] The auditory sense training method of the 
present invention is used for training language hearing 
skills by making a trainee listen to a sound generated 
by combining a processed sound to a language. 
[0068] The auditory sense training method of the 
present invention mentioned above is performed by 
making a trainee listen to the region attenuation proc- 
essed sound attenuating a predetermined frequency re- 
gion against an original sound as the background of a 
language. 

[0069] The region attenuation processed sound could 
either be language or any sound other than language. 
[0070] The auditory sense training method for lan- 
guage training according to the present invention men- 
tioned above outputs said region attenuation processed 
sound continuously by a small amplitude as the back- 
ground of a language. 

[0071] Further, the auditory training method for lan- 
guage training according to the present invention out- 
puts said region attenuation processed sound discon- 
tinuous^ as the background of a language. 
[0072] The auditory sense training method for lan- 
guage training according to the present invention sets 
high band attenuation processed sound by attenuating 
the region over a specific frequency of above 2000 Hz. 
[0073] Moreover, the auditory sense training method 
for language training according to the present invention 
sets the region attenuation processed sound as a com- 
bination of a low band attenuation processed sound 
where a region of below a specific frequency in the 
range between 1800 Hz and 7000 Hz is attenuated and 
a high band attenuation processed sound where a re- 
gion of over a specific region of over 2000 Hz is atten- 
uated. 

[0074] The auditory sense training method for lan- 
guage training according to the present invention per- 
forms said region attenuation process to a plurality of 
various frequencies, sets said frequency and the proc- 
ess time randomly, and arranges the process according 
to time. 

[0075] The auditory sense training method utilizing 
said region attenuation processed sound gained by per- 
forming the region attenuation process to the original 
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sound performs a process to amplify the amplitude of 
the processed sound being attenuated by the region at- 
tenuation process. 

[0076] The amplification of the amplitude may be in 
the level to return the amplitude being attenuated by the 
region attenuation process to the original level, or the 
amplitude may either be amplified to an amplitude ex- 
ceeding the original amplitude, or may be amplified be- 
low the original amplitude. 

[0077] In order to solve the above-mentioned prob- 
lems, a sound processing method for auditory sense 
training for use in an auditory sense training method for 
training auditory sense by listening to a sound generat- 
ed by processing an original sound -according to the 
present invention performs a region attenuation process 
for attenuating a desired frequency region of the original 
sound. 

[0078] The sound processing method for auditory 
sense training according to the present invention sets 
the region for performing the attenuation process of the 
original sound to a region below a predetermined fre- 
quency in the range between 1800 Hz and 7000 Hz. 
[0079] Further, the sound processing method for au- 
ditory sense training according to the present invention 
sets the region for performing the attenuation process 
of the original sound to a region above a predetermined 
frequency in the range between 2000 Hz and 7000 Hz. 
[0080] Even further, the sound processing method for 
auditory sense training according to the present inven- 
tion sets the region for performing the attenuation proc- 
ess against the original sound to two regions, a region 
below a predetermined frequency in the range between 
1800 Hz and 7000 Hz, and a region above a predeter- 
mined frequency in the range between 2000 Hz and 
7000 Hz. 

[0081] Further, the sound processing method for au- 
ditory sense training according to the present invention 
sets the region for performing the attenuation process 
of the original sound to a combination of two regions, a 
region below a predetermined frequency in the range 
between 1800 Hz and 7000 Hz, and a region above a 
predetermined frequency in the range between 2000 Hz 
and 7000 Hz. 

[0082] Further, the sound processing method for au- 
ditory sense training according to the present invention 
sets the region for performing the attenuation process 
of the original sound to a region below a predetermined 
frequency in the range between 1800 Hz and 7000 Hz, 
and a combination of two regions; a region below a pre- 
determined frequency in the range between 1800 Hz 
and 7000 Hz, and a region above a predetermined fre- 
quency in the range between 2000 Hz and 7000 Hz. 
[0083] Further, the sound processing method for au- 
ditory sense training according to the present invention 
sets the region for performing the attenuation process 
of the original sound to a region above a predetermined 
frequency in the range between 2000 Hz and 7000 Hz, 
and a combination of a region below a predetermined 



frequency in the range between 1800 Hz and 7000 Hz 
and a region above a predetermined frequency between 
2000 Hz and 7000 Hz. 

[0084] Further, the sound processing method for au- 

5 ditory sense training according to the present invention 
sets the region for performing the attenuation process 
of the original sound to a region below a predetermined 
frequency in the range between 1800 Hz and 7000 Hz, 
a region above a predetermined frequency in the range 

10 between 2000 Hz and 7000 Hz, and a combination of 
two regions of a region below a predetermined frequen- 
cy in the range between 1800 Hz and 7000 Hz and the 
region above a predetermined frequency in the range 
between 2000 Hz and 7000 Hz. 

15 [0085] According to the sound processing method for 
auditory sense training mentioned above, the region at- 
tenuation process is performed targeting a plurality of 
various frequencies, and said frequencies and the 
processing time is set randomly and arranged in time 

20 order. 

[0086] In order to solve the above-mentioned prob- 
lems, the present invention provides a sound process- 
ing method for auditory sense training to be utilized in 
an auditory sense training method by listening to a 

25 sound of more than two channels formed by processing 
an original sound, wherein a panpot process is per- 
formed where an amplitude attenuation processed 
sound formed by attenuating the amplitude of an original 
sound of one channel is outputted to one channel, and 

30 an amplitude attenuation processed sound formed by 
attenuating the amplitude of an original sound of one 
channel is superposed to the original sound of the otner 
channel and outputted to the other channel. 
[0087] Such panpot process could be performed in- 

35 dependently to each channel. 

[0088] According to the sound processing method for 
auditory sense training of the present invention, the pan- 
pot processed sound which is formed by panpot 
processing a sound is outputted alternately with a sound 

40 which has not been performed of said panpot process. 
[0089] According to the sound processing method for 
auditory sense training of the present invention, said 
panpot process is performed so that the sum of the am- 
plitude attenuation processed sound outputted to one 

45 channel and the amplitude attenuation processed 
sound outputted to the other channel is fixed for a chan- 
nel signal. 

[0090] According to the sound processing method for 
auditory sense training of the present invention, the pan- 
50 pot process is performed by a plurality of various 
processing patterns, said processing pattern and the 
processing time set randomly and arranged in time or- 
der. 

[0091] Moreover, in order to solve the above men- 
55 tioned problems, the present invention provides a sound 
processing method for auditory sense training so as to 
train the auditory sense by listening to a sound formed 
by processing an original sound, wherein a phase re- 
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verse process is performed to the original sound for re- 
versing the phase of the original sound. 
[0092] According to the present invention regarding a 
sound processing method for auditory sense training 
performing said phase reverse process, said phase re- 5 
verse process sets the processing time randomly. 
[0093] In order to solve the above-mentioned prob- 
lem, the present invention regarding a sound processing 
method for auditory sense train ing combines said region 
attenuation precessing method and said panpot 10 
processing method. 

[0094] Moreover, the sound processing method for 
auditory sense training of the present invention com- 
bines said region attenuation processing method and 
said phase reverse processing method. 15 
[0095] Further, the sound processing method for au- 
ditory sense training of the present invention combines 
said panpot processing method and said phase reverse 
processing method. 

[0096] Moreover, the sound processing method for 20 
auditory sense training combines said region attenua- 
tion processing method, said panpot processing method 
and said phase reverse processing method. 
[0097] The sound processing method for auditory 
sense training of the present invention defines said orig- 25 
ina! sound to one of the following; either natural sound 
or artificial sound, voice or non-voice, or tone or noise. 
[0098] Natural sound includes all sound except sound 
generated artificially. Voice includes all the voice gener- 
ated by a human, and non-voice includes all sounds ex- 30 
cept voice. Tone includes every sound except for noise, 
and noise includes all sound other than tone. 
[0099] According to the sound processing method for 
auditory sense training of the present invention, the orig- 
inal sound combines natural sound or artificial sound, 35 
voice or non-voice, or tone or noise. 
[0100] In order to solve the above-mentioned prob- 
lems, the sound processing method for auditory sense 
training of the present invention is used for the training 
of language hearing skills by combining a processed 40 
sound to voice. 

[0101] In order to solve the above-mentioned prob- 
lems, an auditory sense training device to be used for 
an auditory sense training method for training the audi- 
tory sense by listening to a sound formed by processing 45 
an original sound, comprises a band attenuation means 
for attenuating a predetermined frequency region of an 
original sound, and a switching means for selectively 
outputting the output of said band attenuation means 
and said original sound. so 
[0102] The auditory sense training device of the 
present invention comprises a band attenuation means 
comprising a plurality of band attenuation means and a 
selecting means for selectively outputting the output 
from said band attenuation means. 55 
[0103] According to the auditory sense training device 
of the present invention, the band attenuation means 
comprises a low band attenuation means for attenuating 
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the region below a predetermined frequency in the 
range between 1800 Hz and 7000 Hz. 
[01 04] According to the auditory sense training device 
of the present invention, the band attenuation means 
comprises a high band attenuation means for attenuat- 
ing the region above a predetermined frequency in the 
range between 2000 Hz and 7000 Hz. 
[01 05] According to the auditory sense training device 
of the present invention, the band attenuation means 
comprises two region attenuation means for attenuating 
two regions; a region below a predetermined frequency 
in the range between 1800 Hz and 7000 Hz, and a re- 
gion above a predetermined frequency in the range be- 
tween 2000 Hz and 7000 Hz. 

[01 06] According to the auditory sense training device 
of the present invention, the band attenuation means 
comprises a combination of a low band attenuation 
means for attenuating a region below a predetermined 
frequency in the range between 1800 Hz and 7000 Hz, 
and a high band attenuation means for attenuating a re- 
gion above a predetermined frequency in the range be- 
tween 2000 Hz and 7000 Hz. 

[01 07] According to the auditory sense training device 
of the present invention, the band attenuation means 
comprises a combination of a low band attenuation 
means for attenuating a region below a predetermined 
frequency in the range between 1800 Hz and 7000 Hz, 
and a two region attenuation means for attenuating two 
regions; a region below a predetermined frequency in 
the range between 1800 Hz and 7000 Hz and a region 
above a predetermined frequency in the range between 
2000 Hz and 7000 Hz. 

[01 08] According to the auditory sense training device 
of the present invention, the band attenuation means 
comprises a combination of a low band attenuation 
means for attenuating a region below a predetermined 
frequency in the range between 1800 Hz and 7000 Hz, 
a high band attenuation means for attenuating a region 
above a predetermined frequency in the range between 
2000 Hz and 7000 Hz, and a two region attenuation 
means for attenuating two regions; a region below a pre- 
determined frequency in the range between 1800 Hz 
and 7000 Hz and a region above a predetermined fre- 
quency in the range between 2000 Hz and 7000 Hz. 
[01 09] According to the auditory sense training device 
of the present invention, the band attenuation means 
sets a plurality of various frequencies and processing 
time randomly. 

[0110] In order to solve the above-mentioned prob- 
lems, the present invention provides an auditory sense 
training device to be used in an auditory sense training 
method by listening to a sound of more than two chan- 
nels formed by processing an original sound, wherein a 
panpot processing means is equipped for outputting an 
amplitude attenuation processed sound formed by at- 
tenuating the amplitude of an original sound of one 
channel to one channel, and for outputting to the other 
channel an amplitude attenuation processed sound 
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formed by attenuating the amplitude of an original sound 
of one channel which is superposed to the original 
sound of the other channel. 

[01 1 1 ] Such panpot process could be performed inde- 
pendently to each channel. 

[011 2] According to the auditory sense training device 
of the present invention, said panpot processing means 
is formed of mare than four variable attenuation means 
and more than two adding means, said each variable 
attenuation means formed as a variable means control- 
led of its attenuation quantity by an attenuation coeffi- 
cient, and inputting to said each adding means an output 
from said variable attenuation means of one channel 
and an output of another variable attenuation means. 
[01 1 3] According to the auditory sense training device 
of the present invention, said panpot processing means 
is formed so that the sum of the amplitude attenuation 
signal outputted to one channel and the amplitude at- 
tenuation signal outputted to the other channel is fixed 
for a channel signal. 

[011 4] According to the auditory sense training device 
of the present invention, the panpot processing method 
is performed by a plurality of various processing pat- 
terns, and said processing patterns and the processing 
time are set randomly. 

[0115] Moreover, in order to solve the above men- 
tioned problems, the present invention provides an au- 
ditory sense training device to be used for auditory 
sense training method for training the auditory sense by 
listening to a sound formed by processing an original 
sound, wherein a phase reverse processing means is 
further equipped for reversing the phase of the original 
sound by a predetermined pattern. 
[01 1 6] According to the auditory sense training device 
of the present invention, the phase reverse processing 
means comprises of a phase reverse means for revers- 
ing the phase of an original sound by a predetermined 
pattern, and a selecting means for selectively outputting 
an output of said phase reverse means and the original 
sound based on a phase reverse control signal. 
[0117] In order to solve the above-mentioned prob- 
lems, the present invention provides an auditory sense 
training device comprising a band attenuation means for 
attenuating a predetermined frequency region of an 
original sound, and a switching means for selectively 
outputting the output of said band attenuation means 
and said original sound. 

[0118] The present invention provides an auditory 
sense training device to be used in an auditory sense 
training method for training auditory sense by listening 
to a sound formed by processing an original sound, the 
device being equipped with a panpot processing means 
for superposing a voice signal formed by applying an 
amplitude attenuation process to an original sound of 
one channel to the original sound of another channel. 
[0119] The present invention provides an auditory 
sense training device equipped with a phase reverse 
processing means for reversing the phase of an original 



sound by a predetermined pattern. 
[0120] The present invention provides an auditory 
sense training device comprising a band attenuation 
means for attenuating a predetermined frequency re- 

s gion of the original sound, a switching means for selec- 
tively outputting the output of said band attenuation 
means and said original sound, and a panpot process- 
ing means for superposing a voice signal formed by pro- 
viding an amplitude attenuation process to the original 

10 sound of one channel to the original sound of another 
channel. 

[0121] The present invention provides an auditory 
sense training device comprising a panpot processing 
means for superposing a voice signal formed by provid- 
es ing an amplitude attenuation process to the original 
sound of one channel to the original sound of another 
channel, and a phase reverse processing means for re- 
versing the phase of the original sound by a predeter- 
mined pattern. 

20. [0122] The present invention provides an auditory 
sense training device comprising a band attenuation 
means for attenuating a predetermined frequency re- 
gion of the original sound, a switching means for selec- 
tively outputting the output of said band attenuation 

25 means or the original sound, a panpot processing 
means for superposing a voice signal formed by provid- 
ing an amplitude attenuation process to the original 
sound of one channel to the original sound of another 
channel, and a phase reverse processing means for re- 

30 versing the phase of the original sound by a predeter- 
mined pattern. 

[0123] In order to solve the above-mentioned prob- 
lems, a recording medium for auditory sense training ac- 
cording to the present invention records a processed 
35 sound formed by processing a sound according to the 
above-mentioned sound processing method for audito- 
ry sense training. 

[0124] The recording medium of the present invention 
is either a compact disk (CD), a magneto-optical disk 
40 (MO), magnetic recording medium such as floppy disk 
and magnetic tape, or semiconductor memory such as 
semiconductor RAM and semiconductor ROM. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0125] 

FIG. 1 shows the waveform of the original sound to 
which the panpot process is performed in the 
present invention; 

FIG. 2 shows the waveform of the panpot processed 
sound according to the present invention; 
FIG. 3 is an explanatory view showing the contents 
of the region attenuation process according to the 
present invention; 

FIG. 4 is a block diagram showing the structure of 
the auditory sense training device according to the 
present invention; 
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FIG. 5 is a block diagram showing the structure of 

the band attenuation processing means; 

FIG. 6 is a block diagram showing the structure of 

the panpot processing means; 

FIG. 7 is an explanatory view showing the actual 

example of the panpot process; and 

FIG. 8 is a block diagram showing the structure of 

the phase reverse processing device. 

PREFERRED EMBODIMENT OF THE INVENTION 

[0126] The embodiment of the present invention will 
now be explained. The present embodiment relates to 
an auditory sense training method so as to release a 
trainee from the practice of strengthening the vowel 
when listening to music or foreign language which is a 
characteristic of the mother tongue, by making a trainee 
listen to a voice whose sound source is treated with a 
specific process. 

[0127] In the present specification , sound is defined 
as any sound such as a natural sound or an artificial 
sound, voice or non-voice, or tone or noise. 
[0128] Natural sound includes all sound except sound 
generated artificially. Voice includes all voice generated 
by human, and non-voice includes all sound except 
voice. Tone includes all sound except noise, and noise 
includes all sound except tone. 

[0129] Moreover, an original sound refers to a sound 
which has not been performed of the process according 
to the present invention, and a processed sound refers 
to a sound which has been performed of the process 
according to the present invention. 
[01 30] When superposing a plurality of processes, the 
processed sound being performed of the former process 
is called the original sound in the latter process. 
[0131] Moreover, sound source refers to a supply 
source of the original sound, for which a CD (compact 
disk) could mainly be used, and the contents of the 
sound source could be any of the following; music, nat- 
ural sound, sampling sound, synthetic sound, sound re- 
ducing an electric wave to an audible tone region, pulse 
tone, spoken language from a CD for language learning 
and the like. 

[0132] When the object of the audible sense training 
is set, the audible sense training could be performed by 
playing a recording medium which has been recorded 
of the processed sound performed of the process ac- 
cording to the present invention, wherein the recording 
medium could be any of the following; CD, MD, magnet- 
ic recording medium such as a floppy disk or a magnetic 
tape, a semiconductor memory such as a semiconduc- 
tor RAM or a semiconductor ROM, and the like. 
[0133] The present invention is constituted by com- 
bining a plurality of basic process patterns. 
(1) A pattern for performing a process wherein an am- 
plitude attenuated sound formed by attenuating the am- 
plitude of an original sound of one channel is outputted 
to one channel, and the amplitude attenuation sound 



formed by attenuating the amplitude of the original 
sound of one channel is superposed to the original 
sound of another channel and outputted to the other 
channel. 

5 [01 34] This process is called a panpot process in the 
present specification, and the sound treated by the pan- 
pot process is called a panpot processed sound. 
(2) A pattern for performing the process of attenuating 
a specific frequency region of an original sound by pass- 

10 jng the original sound to a filter and the like. 

[0135] This process is called a region attenuation 
process in the present specification, and the sound per- 
formed of the region attenuation process is called a re- 
gion attenuation processed sound. 

is (3) Apattern for performing the process of reversing the 
phase of the original sound on either the left or the right 
channel. 

[01 36] This process is called a phase reverse process 
in the present specification, and the sound performed of 
20 the phase reverse process is called a phase reverse 
processed sound. 

[01 37] In the present specification, the phase reverse 
process is not restricted to reversing the phase for 180 
degrees, but also includes shifting the phase of the orig- 
25 jnal sound for roughly 180 degrees. 

(4) A pattern which optionally combines the processes 
disclosed in (1) through (3). 

[0138] When the auditory sense training is aimed at 
language learning, the processed sound treated of the 
30 above-mentioned processes is used as the background 
of the conversation, and when it is aimed at training au- 
ditory sense of music, the processed sound itself is lis- 
tened to. 

[0139] The consent of the panpot process is now ex- 

05 plained by taking an example of the panpot process be- 
ing performed to the sound source of the right channel. 
[01 40] The panpot process is a process for superpos- 
ing one portion of the sound source of each of the left 
and right channels to the sound source of the other 

40 channel and outputting the same. 

[0141] When the panpot processing quantity of the 
right channel is 0 %, the original sound on the right chan- 
nel itself is outputted only from the right channel, and 
the original sound on the right channel will not be out- 

45 putted from the left channel. 

[0142] When the panpot processing quantity of the 
right channel is 50 %, the processed sound formed by 
attenuating 50 % of the original sound is outputted to 
the right channel, and the processed sound formed by 

50 attenuating 50 % of the original sound of the right chan- 
nel is outputted to the left channel. In this case, the orig- 
inal sound on the right channel should be heard as a 
monaural sound at the center of both left and right chan- 
nels. 

55 [0143] When the panpot processing quantity of the 
right channel is 75 %, the processed sound attenuating 
75 % of the original sound is outputted to the right chan- 
nel, and on the left channel, an output of the volume of 



17 



EP 1 031 955 A1 



18 



75 % of the original sound on the right channel, that is, 
the processed sound attenuating 25 % of the original 
sound on the right channel is outputted. At this time, the 
original sound on the right channel should be heard so 
that is moved from the center of the left and right chan- 5 
nels toward the left channel side. 
[0144] When the panpot processing quantity of the 
right channel is 100 %, the sound attenuating 100 % of 
the original sound is outputted to the right channel. That 
is, the original sound of the right channel will not be out- 10 
putted to the right channel, and the original sound of the 
right channel will be outputted to the left channel without 
any attenuation. At this time, the original sound on the 
right channel is heard to have moved to the left channel. 
[0145] The example of such panpot process is ex- is 
plained with reference to FIGS. 1 and 2. 
[0146] FIG. 1 is a drawing showing the amplitude 
waveform of the original sound before the panpot proc- 
ess, wherein the time axis is taken as the horizontal axis, 
and the amplitude is taken as the vertical axis. FIG. 2 20 
shows the amplitude waveform after the panpot proc- 
ess, wherein the time axis is taken as the horizontal axis, 
and the amplitude is taken as the vertical axis. In FIG. 
2, the region surrounded by the solid line is the region 
where the panpot process has been performed, wherein 25 
the extension to the upper and lower directions show 
the panpot processing quantity, and the extension to the 
left and right directions show the panpot processing 
time. 

[0147] As shown in the drawing, the panpot process 30 
is performed individually to each of the left and right 
channels, and each processed sound provides an influ- 
ence to the other channel. Moreover, by providing the 
panpot process, the output on one channel is attenuat- 
ed, and the output on the other channel is increased. 35 
[0148] There are following patterns to the panpot 
process forms. 

[0149] The first process pattern is called a "chevron", 
wherein the panpot processing quantity (panpot quan- 
tity) is increased by a fixed ratio from the start, and when 40 
it reaches a predetermined value, the quantity is de- 
creased by a fixed ratio. This form is shown by (1 ) of the 
drawing. The time for changing the panpot quantity from 
the original value to the fixed value, or from the fixed 
value to the original value, is 5 seconds at maximum, 45 
and the processing time is preferably more than 0. 1 sec- 
onds at minimum, and up to 10 seconds at maximum. 
The processing number of times should preferably be 
in the range from 1 to 45 times per one minute as a total 
of both channels. so 
[0150] The second process pattern is a form called 
"trapezoid vertical shape", wherein the panpot quantity 
is increased by a fixed speed, and then maintained at a 
predetermined value for a fixed time, and then returned 
immediately back to the original value. This form is ss 
shown by (2) of the drawing. The time for changing the 
panpot quantity from the original value to the fixed value 
is 5 seconds at maximum, and the fixed maintaining time 



is preferably approximately 0.1 seconds at minimum, 
and 15 seconds at maximum. 

[0151] The third process pattern is a form called "right 
angle shape", wherein the panpot quantity is changed 
immediately to a fixed value, maintained at the prede- 
termined value for a fixed time, and then returned im- 
mediately back to the original value. This form is shown 
by (3) in the drawing. The processing time is preferably 
approximately 0.1 seconds at minimum, and 15 sec- 
onds at maximum. 

[0152] The fourth process pattern is a form called 
"trapezoid symmetry shape", wherein the panpot quan- 
tity is increased by a fixed speed, maintained at the pre- 
determined value for a fixed time, and then returned 
back to the original value by reducing the panpot quan- 
tity with a fixed speed. The processing time for varying 
the panpot quantity from the original value to the fixed 
value, or from the fixed value to the original value is ap- 
proximately 5 seconds at maximum, and the fixed main- 
taining time is preferably 0.1 seconds at minimum and 
1 5 seconds at maximum. 

[0153] According to any of the above-mentioned 
processing patterns, the minimum value of the panpot 
quantity is 50 % and the maximum value is 100 %, but 
since the sound performed of a process with the panpot 
quantity of 1 00 % may sound odd, it is preferred not to 
use it frequently. In contrast, the effect of the auditory 
sense improvement will be reduced when the panpot 
quantity falls below 50 %. 

[0154] According to the above-mentioned panpot 
processes, regardless of the type of process patterns, 
sufficient effect may not be gained if the time from the 
start of the process to the maximum value exceeds 3 
seconds. Similarly, if the time taken from the maximum 
value of the process to return to the original value ex- 
ceeds 3 seconds, the effect gained would not be suffi- 
cient. 

[0155] In order to provide a maximum effect by the 
processes, it is effective not to add a process with a 
gradually rising value or a process with a gradually re- 
turning value (for example, the chevron or the trapezoid 
type process), but the frequent use of rapid process may 
cause symptoms of dizziness or the like. Therefore, by 
mixing the above-mentioned processes to some por- 
tions, the rapid processes could be used more effective- 
ly- 

[0156] The example of the region attenuation 
processing pattern will now be explained with reference 
to FIG. 3. 

[01 57] In the drawing, the horizontal axis shows time, 
and the waveforms extending horizontally in the upper 
and lower directions of the drawing show the type of 
waveforms of the sound source, and the upper and low- 
er areas from the center line show the contents of the 
region attenuation process. 

[01 58] According to the contents of the region process 
in the present example, a non-processing where the 
original sound is not processed, a process for attenuat- 
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ing each region of below either 2000 Hz, 2500 Hz, 3000 
Hz, 4000 Hz, or 5000 Hz of the original sound, or a proc- 
ess for attenuating the region over 5000 Hz of the orig- 
inal sound is performed randomly. 
[0159] As shown in the drawing, in the left channel, a 
specific frequency region is attenuated by a random 
continuation time as in the following example; a little 
over 2 seconds of non-processing, a little over 2 sec- 
onds of attenuation below 2500 Hz, 1 .5 seconds of non- 
processing, a little over 2 seconds of attenuation below 
4000 Hz, 1 second of non-processing, 0.5 seconds of 
attenuation under 4000 Hz, 2 seconds of non-process- 
ing, 1 second of attenuation below 3000 Hz, and so on. 
[0160] Similarly, in the right channel, a specific fre- 
quency region is attenuated by a random continuation 
time as in the following example; 2.5 seconds of non- 
processing, a little under 1 second of attenuation below 
2500 Hz, a little over 0.5 seconds of non-processing, 1 
second of attenuation below 2500 Hz, a little over 0.5 
seconds of non-processing, 2 seconds of attenuation 
below 4000 Hz, 1 second of non-processing, 1.5 sec- 
onds of attenuation below 4000 Hz, a little under 2 sec- 
onds of non-processing, a little over 5 seconds of atten- 
uation under 3000 Hz, and so on. 
[0161] Such region attenuation process should pref- 
erably be approximately 0.1 seconds at minimum and 7 
seconds at maximum, and the number of region atten- 
uation process to be performed by both channels as to- 
tal should preferably be in the range between 1 to 60 
times. 

[0162] In the example of the region attenuation proc- 
ess disclosed above, a process of either attenuating a 
region below a specific frequency or attenuating a re- 
gion above a specific frequency was performed. How- 
ever, a process of attenuating a specific frequency re- 
gion of between a specific frequency and to leave the 
other frequency regions, or a process of attenuating the 
upper and lower frequency regions to leave only the 
central frequency regions may also be performed. 
[0163] Moreover, since the region attenuation proc- 
essed sound having been performed of the above-men- 
tioned process has a reduced amplitude, it is preferable 
that an amplifying process would be performed thereto 
so as to return the amplitude back to the original value. 
[0164] Further, the process was discontinuous in the 
above-mentioned region attenuation example, but the 
region attenuation process could be performed contin- 
uously of a predetermined frequency, or the region at- 
tenuation process could also be performed by continu- 
ously varying the frequency. 

[0165] By carrying out such processes, either the low 
frequency components would be reduced or the high 
frequency components would be strengthened random- 
ly, which is considered to work so as to reduce the effect 
or the anticipation of strengthening the vowel or hearing 
the reverbaration. 

[0166] The phase reverse process is explained here- 
inafter. The phase reverse process is a process to re- 



verse the phase of an original sound on either the left 
or the right channel for a predetermined period of time, 
and to provide a stimulation to the auditory sense. 
[0167] The phase reverse process could be per- 
5 formed to either the left or the right channel, since from 
the auditory sense point of view, the phase reverse per- 
formed to the right channel and the phase reverse per- 
formed to the left channel seems similar, though it may 
involve technical differences. 
io [0168] The minimum time for performing the phase re- 
verse process is 0.1 seconds and the maximum is 10 
seconds. The number of phase reverse process to be 
performed is preferably once at minimum, and 600 times 
at maximum for the total of both channels per minute. 
is Both the timing and the time for performing the phase 
reverse process could be set randomly. 
[0169] Similar to the panpot processor the high region 
attenuation process, the phase reverse process is used 
for auditory sense training after performing the low re- 
gion attenuation process. The low region attenuation 
processing method is similar to the panpot process or 
the high region attenuation process. 
[0170] The phase reverse process could either be 
used independently, or combined with the panpot proc- 
ess or the high region attenuation process. 
[0171] According to the training method of the present 
invention, a various process forms could be gained by 
combining a simple process disclosed in (1 ), (2) and (3). 



[0172] The actual example of the combination of the 
region attenuation process and the panpot process will 
be explained below. 

35 [0173] In this example, the frequency for performing 
the region attenuation process (process frequency) is 
set to the range between 1800 Hz and 7000 Hz, and the 
region below a process frequency is attenuated by tar- 
geting a frequency separated by more than 500 Hz from 

40 the processing frequency positioned in the peripheral 
areas. 

[0174] The process for performing the attenuation 
process against a frequency region under the process 
frequency is called "low band attenuation process" in the 

45 present specification. 

[0175] This low band attenuation process is per- 
formed so that the attenuation is performed to -6dB to 
-10dB for the frequency of approximately 65 % in each 
process frequency, and -20dB for the frequency below 

50 65 % against the original sound. For example, when the 
process frequency is 2000 Hz, attenuation is performed 
by setting the value to -1 OdB from 2000 Hz to 1 300 Hz 
(which is 65 % of 2000 Hz), and setting the value to be- 
low -20dB under 1 300 Hz. 

55 [01 76] The minimum time for processing the low band 
attenuation process is 0.1 seconds, and the maximum 
time is approximately 7 seconds in order to gain effec- 
tive results. 
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[0177] The low band attenuation process should pref- 
erably be performed once at minimum, and 60 times at 
maximum as total of the left and right channels. 
[0178] The low band attenuation process could also 
be performed in steps where a plurality of low band at- 5 
tenuation processes against a various frequency region 
mentioned above are superposed. 
[01 79] That is, when superposing the low band atten- 
uation processes of 2000 Hz and 2500 Hz in steps, the 
frequency over 2500Hz is non-processed, the range be- 10 
tween 2000 Hz and 2500 Hz is performed of an attenu- 
ation process of -10dB, the range between 1625 Hz and 
2000 Hz of -20dB, the range between 1300 Hz to 1625 
Hz of -30dB, and the range below 1300 Hz of -40dB. 
[0180] Such step-like superposing process would is 
have a meaning as an auditory sense training since it 
attenuates a low frequency region, but it is effective in 
maintaining this training, which is separate from auditory 
training effects, in that the low frequency regions should 
be somewhat left so as to provide an easy-to-listen proc- 20 
essed sound. Therefore, the attenuation quantity should 
not exceed approximately-30dB. 
[0181] Such superposed process against various fre- 
quencies should be performed so that the processing 
time of each process frequency should not be super- 2s 
posed above 50 % in a single time band. 
[0182] On the other hand, a process for attenuating 
the region above a predetermined process frequency in 
the range between 2000 Hz and 7000 Hz exists. This 
process is called "high band attenuation process". By 30 
interposing a high band attenuation process bettween 
low band attenuation processes, the effect of the audi- 
tory sense training could be improved. 
[0183] Unlike the low band attenuation process, the 
high band attenuation process requires a large attenu- 35 
ation directly from the process frequency, and the atten- 
uation could be larger than -10db, and preferably larger 
than -20dB. 

[0184] When interposing the high band frequency 
process, the number of the process should be twice to 40 
50 times as a total of both channels per minute. 
[0185] Moreover, there is a process for superposing 
two processes; a process for attenuating the region low- 
er than the process frequency in the range between 
1 800 Hz and 7000 Hz, and a process for attenuating the *s 
region above the frequency in the range between 2000 
Hz and 7000 Hz. This process is called "two region at- 
tenuation process". The two region attenuation process 
could be interposed between the high band attenuation 
process or the low band attenuation process so as to so 
further improve the effect of the auditory sense training. 
[0186] Next, in the practice example, a panpot proc- 
ess is performed against a processed sound which has 
been performed of the low band attenuation process. 
[0187] After performing the panpot process, the high ss 
band attenuation process is performed. 
[0188] The high band attenuation process is per- 
formed in the range between 2000 Hz and 7000 Hz, 
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which is separated by more than 500 Hz from the ap- 
proximate process frequency. 

[01 89] The low band attenuation process, the panpot 
process, the high band attenuation process, or the 
phase reverse process in such combined process 
should be performed for a total in the left and right chan- 
nels of approximately over 4 times and at a maximum 
of 60 times per minute. 

[01 90] The application of the present invention to lan- 
guage learning or language hearing training is explained 
below. 

[0191] This application utilizes the processed sound 
according to the present invention as a background 
when learning the language. 

[0192] There are two ways in using the processed 
sound for improving the listening skills to the pronunci- 
ation of a native speaker or to perform listening training. 
[0193] The first method is to perform the auditory 
sense training by making the trainee listen to the proc- 
essed sound having been performed of the above-men- 
tioned processes which does not include the voice of 
the native speaker. 

[0194] The second method is to learn a language by 
making the trainee listen to a sound where a processed 
sound having been treated of the above-mentioned 
processes is superposed as background to the pronun- 
ciation of the native speaker. 

[0195] Any sound from a natural sound or an artificial 
sound, voice or non-voice, or tone or noise could be 
used as the sound source to be used as the background, 
and the sounds could be used either independently or 
by an optional combination. 

[0196] The original sound to be used as background 
could either be treated by one of the above-mentioned 
processes; the low band attenuation process, the pan- 
pot process or the phase reverse process, or a combi- 
nation of these processes. 

[0197] The feature of the process to be performed to 
the background in language learning is that the effect of 
the training could be improved by using the sound per- 
formed of only the fow band attenuation process as the 
sound source. Especially, as the low band attenuation 
process in language learning, the region attenuation 
process should preferably be performed against the fre- 
quency in the range between 1 800 Hz and 6000 Hz, and 
used as the background continuously. 
[0198] In the process for the background, the easi- 
ness to hear the language is different for each person 
depending on the variety of the process, but a lasting 
effect of the training could be gained in the following or- 
der: (1) discontinuous low band attenuation process; (2) 
combination of discontinuous low band attenuation 
process and panpot process; (3) combination of discon- 
tinuous low band attenuation process, panpot process 
and phase reverse process; (4) combination of discon- 
tinuous high band attenuation process, panpot process 
and phase reverse process; (5) continuous low band at- 
tenuation process; (6) combination of continuous low 
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band attenuation process and panpot process; (7) com* 
bination of continuous low band attenuation process, 
panpot process and phase reverse process; and (8) a 
mixture of the various processes. 
[0199] In the present method, a non-processed origi- 
nal sound which has not been treated of any of the 
above-mentioned processes is used as the voice of the 
native speaker. Moreover, in the present method, vari- 
ous processed sounds performed of the above-men- 
tioned processes are used as the background. Fven fur- 
ther, in the present invention, the original sound of the 
speaker's voice and the sound combining said various 
processed sounds are used for auditory sense training 
and language learning. 

[0200] It is effective to mix the sounds by attenuating 
the processed sound to be used as the background to 
a range between -8dB and -20dB compared to the vol- 
ume of the language. 

[0201] The effective range of the low band attenuation 
process is approximately between 2000 Hz and 6000 
Hz, but as a more effective frequency, the effective proc- 
ess frequency for a female voice is around 4000 Hz, and 
for a male voice, around 3000 Hz. However, this fre- 
quency depends greatly to the quality of the speaker's 
voice, so it is difficult to fix a specific value. 
[0202] According to this method, the pronunciation of 
the native speaker could be heard in the most natural 
state. 

[0203] The processed sound used as the background 
could be gained by the method processing the original 
sound and outputting the same, or gained by recording 
the processed sound formed by processing the original 
sound to a recording mediums such as CD or magnetic 
tape, and playing the recording medium. 
[0204] Moreover, a sound superposing the processed 
sound formed by processing the original sound and the 
voice of the native speaker could be recorded to a re- 
cording medium such as CD or magnetic tape, and such 
medium could be played for use in language learning. 
[0205] Next, an auditory training device for realizing 
the above-mentioned auditory sense training method is 
explained. 

[0206] FIG. 4 shows a circuit block diagram showing 
the outline of the structure of the auditory sense training 
device according to the present invention. 
[0207] The auditory sense training device 1 is formed 
of two (left and right) channel systems, comprising a 
sound source 1 0, a band attenuation processing means 
20 mounted corresponding to the left and right channels, 
a switching means 30 mounted corresponding to the left 
and right channels, a panpot processing means 40 to 
which the signals from the left and right channels are 
inputted, a phase reverse processing means 50 to which 
the signals from the left and right channels are inputted, 
a voice amplification means 60 mounted corresponding 
to the left and right channels, a voice output means 70 
mounted corresponding to the left and right channels, a 
control means 80, a random time generation means 85 



and a record playback means 90. 
[0208] The sound source 1 0 may utilize a reproduced 
sound from a recording medium such as a CD, a MD, a 
magnetic recording medium or a semiconductor mem- 

s ory and the like, a synthetic sound from a synthesizer, 
or a natural sound from a microphone and the like, and 
its contents could be either an optional sound source 
from music, natural sound, sampling sound, synthetic 
sound, sound generated by dropping the electric wave 

10 to an audible tone band, a pulse-like sound, or a spoken 
language gained from a language learning CD and the 
like. Further, the sound source 10 is not limited to one, 
but rather, could be more than two sound sources. In 
this case, one original sound from one sound source 

is may be used as the original sound without performing 
any processes, and the original sound from the other 
sound source could be selectively outputted as the proc- 
essed sound gained by processing the original sound. 
The original sound from the sound source 10 is output- 

20 ted to one input of the switching means 30 and the band 
attenuation processing means 20. 
[0209] The band attenuation processing means 20 is 
a means for performing the attenuation process for a 
predetermined time and quantity against the specific f re- 

25 quency area of the original sound inputted thereto, 
which is controlled by the control means 80. 
[0210] The band attenuation processing means 20 
performs the region attenuation process to each of the 
left and right channels by independent patterns. 

30 [0211] The region attenuation processed sound out- 
putted from the band attenuation processing means 20 
is outputted to the other input of the switching means 30. 
[0212] The switching means 30 is controlled by the 
control means 80, and selects either the original sound 

35 from the sound source 1 0 or the region attenuation proc- 
essed sound from the band attenuation processing 
means 20 for output to the panpot processing means 40. 
[021 3] The panpot processing means 40 is controlled 
by the control means 80, and performs a predetermined 

40 distribution process against either the original sound 
from the left and right channels or the region attenuation 
processed sound inputted from the switching means 30, 
which is then intersected and outputted to the left and 
right channels. The panpot processed sound is output- 

45 ted to the phase reverse processing means 50. 

[0214] The phase reverse processing means 50 is 
controlled by the control means 80, and performs a 
phase reverse process against either the left or right 
channels of the panpot processed sound from the pan- 

50 pot processing means 40. The output of the phase re- 
verse means 50 is amplified to a desired volume by the 
voice amplification means 60, and outputted from the 
voice output means 70 of a speaker or a headphone and 
the like. Further, the output of the phase reverse means 

55 50 is outputted to the record playback means 90, and 
may be recorded to the recording medium 95. 
[0215] The control means 80 is a means for control- 
ling the whole system of the auditory sense training de- 
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vice 1, and based on the timing from the random time 
generation means 85, performs the control of the region 
attenuation process of the band attenuation processing 
means 20, the selective control of the switching means 
30, the panpot processing control of the panpot process- 
ing means 40, or the phase reverse process control of 
the phase reverse processing means 50 and the like. 
[0216] FIG. 5 is used to explain an example of the 
structure of the band attenuation processing means 20. 
[0217] The band attenuation processing means 20 
comprise a plurality of region attenuation means 21 -1 to 
21-4, and a selecting means 22 for selecting and out- 
putting the output of said region attenuation means. 
[0218] The region attenuation means 21 comprises a 
plurality of low band attenuation means 21-1 to 21-2, a 
plurality of two region attenuation means 21-3, and a 
plurality of high band attenuation means 21-4. 
[0219] The low band attenuation means 21-1 and 
21-2 are formed for example by a combination of a plu- 
rality of high-pass filters, and works to attenuate the 
band under a processing frequency f 1 . The low band 
attenuation means 21 -1 and 21 -2 should preferably hold 
a pattern for attenuating -10dB from the processing fre- 
quency f1 to a predetermined frequency fV (for exam- 
ple, a frequency gained by multiplying 0.65 to the 
processing frequency f1: fV=0.65f1) and attenuating 
-20dB below said predetermined frequency f1 or a pat- 
tern for optionally varying the attenuation level from OdB 
to -20dB from the processing frequency f1 to the prede- 
termined frequency fV . 

[0220] The processing frequency should preferably 
be set in units of 500 Hz, and in the range between 1 800 
Hz and 6000 Hz. 

[0221] The two region attenuation means 21-3 is 
formed by combining a high-pass filter and a low-pass 
filter, and works to pass only the signal of a predeter- 
mined frequency band, and attenuate the high frequen- 
cy region and the low frequency region. 
[0222] The high band attenuation means 21-4 is 
formed for example by a low-pass filter, and works to 
attenuate by a predetermined pattern the frequency re- 
gion over the processing frequency fh. 
[0223] The selecting means 22 selects either of the 
output from said each region attenuation means 21-1 
through 21-4 or a combination of a plurality of outputs 
based on the band selection control signal from the con- 
trol means 80, and outputs a region attenuation proc- 
essed sound. 

[0224] FIG. 6 is used to explain the example of the 
structure of the panpot processing means 40. 
[0225] The panpot processing means 40 comprises 
of four variable attenuation means 41 - 44, a coefficient 
generation means 45, and two adding means 46 and 47. 
[0226] Each variable attenuation means 41 - 44 is 
controlled of their attenuation quantity by the attenuation 
coefficient generated by a coefficient generation means 
45. The attenuation coefficient of the variable attenua- 
tion means LL41 and the variable attenuation means 



LR42 is set so as to reach 100% when added together, 
and similarly, the attenuation coefficient of the variable 
attenuation means RL43 and the attenuation coefficient 
of the variable attenuation means RR44 is set so as to 
5 reach 100% when added together. 

[0227] The left channel input is inputted to the variable 
attenuation means LL41 and LR42. The right channel 
input is inputted to the variable attenuation means RL43 
and RR44. 

10 [0228] The output of the variable attenuation means 
LL41 and RL43 are outputted to the adding means 46 
as a panpot processed left channel output, and the out- 
put of the variable attenuation means LR42 and RR44 
are outputted to the adding means 47 as a panpot proe- 
ms essed right channel output. 

[0229] The coefficient generation means 45 outputs 
the attenuation coefficient to each variable attenuation 
means 41 - 44 so as to form a predetermined panpot 
processing pattern with random time intervals, based on 
20 the coefficient generation control signal outputted from 
the control means 80. 

[0230] The example of the pattern of attenuation co- 
efficients generated by the coefficient generation means 
45 are shown in FIG. 7. 

25 [0231] The attenuation coefficient to the variable at- 
tenuation means LL41 to which the left channel signal 
is inputted is shown by a , and the attenuation coefficient 
to the variable attenuation means LR42 is shown by 
100-a. The attenuation coefficient to the variable atten- 

30 uation means RL43 to which the right channel signal is 
inputted is shown by 100-p, and the attenuation coeffi- 
cient to the variable attenuation means RR44 is shown 
by p. 

[0232] As shown, the attenuation coefficient is ran- 
35 domly varied, the size or form of variation also shown 
randomly. Moreover, the generation pattern of the atten- 
uation coefficient is varied for the right channel and the 
left channel. 

[0233] FIG. 8 is used to explain an example of the 
40 structure of the phase reverse processing means 50. 
[0234] The phase reverse processing means 50 is 
formed of a phase reverse means 51 for reversing the 
phase of the input signal, and a selecting means 52 for 
selecting and outputting one input out of the two inputs. 
45 The phase reverse process should be performed to ei- 
ther one of the input from the right channel or the input 
from the left channel. 

[0235] For example, the left channel signal is inputted 
to one of the inputs of the phase reverse means 51 and 
50 the selecting means 52, while the right channel signal 
is outputted in the original state where no phase reverse 
process is performed. 

[0236] A signal performed of the phase reverse proc- 
ess by the phase reverse means 51 and a signal per- 
55 formed of no phase reverse process which is not 
changed from when it entered the phase reverse 
processing means 50 are inputted to the selecting 
means 52, and based on the phase reverse control sig- 
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nal from the control means 80, selects and outputs ei- 
ther one of the input signals. 

[0237] The operation of the present auditory sense 
training device is explained in the following. 
[0238] The original sound inputted from the sound 5 
source 10 is performed of the region attenuation proc- 
ess of a predetermined timing and pattern at the band 
attenuation processing means 20 for each of the left and 
right channels based on the band selection control sig- 
nal, thereby forming the region attenuation processed 10 
signal, and outputted to one input terminal of the switch- 
ing means 30. Further, the original sound inputted from 
the sound source 10 is inputted to the other input termi- 
nal of the switching means 30. 

[0239] The switching means 30 selects either of the 15 
input signals based on the region attenuation process- 
ing pattern, and outputs the same to the panpot process- 
ing means 40. 

[0240] The panpot processing means 40 performs a 
panpot process against the input signal by a predeter- 20 
mined timing and pattern based on the coefficient gen- 
eration control signal, and outputs the same as a panpot 
processed signal to the phase reverse processing 
means 50. 

[0241] The phase reverse processing means 50 per- 25 
forms a phase reverse process against the signal from 
the panpot processing means 40 by a predetermined 
timing based on the phase reverse control signal, and 
outputs the same to the voice amplification means 60. 
[0242] The voice amplification means 60 amplifies the 30 
signal from the phase reverse processing means 50, 
and outputs the voice signal from the voice output 
means 70 of a speaker and the like. 
[0243] The voice signal is then converted to a sound 
signal at the voice output means 70 and outputted as ss 
voice. 

[0244] The order of the region attenuation process, 
the panpot process and the phase reverse process dis- 
closed in the above explanation is not restricted to such, 
but could be of any order. Further, it may only comprise *o 
one or more of the above-mentioned processes. 
[0245] The above description showed a method to 
perform the auditory sense training only by use of a 
processed sound. However, by combining the proc- 
essed sound with images, the auditory sense could be *s 
trained more effectively. 

[0246] Moreover, the auditory sense could also be 
trained by playing back with an ordinary reproduction 
device the recording medium recording the sound per- 
formed of the auditory sense training sound processing so 
method according to the present invention. 
[0247] As explained above, by using the processed 
sound gained by the voice processing method for im- 
proving auditory sense according to the present inven- 
tion, the sensibility of the Japanese speaker against ss 
sound could be removed. That is, by making the trainee 
listen to a region attenuation processed signal formed 
by treating an original sound of music or voice with a 



region attenuation process, the practice formed corre- 
sponding to the characteristic of the Japanese language 
of unconsciously strengthening the vowel in a sound or 
unconsciously deleting the consonant in a sound, or to 
anticipate a reverbaration which does not exist, could 
be removed, and the effect in learning a language could 
be improved. 

[0248] Moreover, even when learning music, the train- 
ee may listen to music without being influenced by the 
Japanese sensibility formed by the characteristics of the 
Japanese language, and even when playing an instru- 
ment, the trainee may play without being influenced by 
the Japanese sensibility. 

[0249] Further, the auditory sense training device for 
performing said voice processing for improving auditory 
sense is capable of providing a processed sound suita- 
ble for application to the above mentioned method, so 
it could be utilized in language learning and music learn- 
ing. 

[0250] By recording the processed sound gained by 
the voice processing method to a recording medium, the 
auditory sense could be trained by playing back the 
processed sound from the recording medium by use of 
a reproduction device. 



Claims 

1. An auditory sense training method for training au- 
ditory sense by having a sound formed by process- 
ing an original sound listened to: wherein 

a region attenuation processed sound formed 
by attenuating a predetermined frequency region of 
said original sound is listened to by a trainee. 

2. An auditory sense training method according to 
claim 1 , wherein said region attenuation processed 
sound formed by attenuating a predetermined fre- 
quency region of said original sound is either lis- 
tened to continuously, or said region attenuation 
processed sound together with either said original 
sound, a silence portion, or said original sound and 
said silence portion are listened to alternately by 
said trainee. 

3. An auditory sense training method according to 
claim 1 , wherein the region of said original sound to 
be performed of said attenuation process is either 
a region under a predetermined frequency in the 
range between 1 800 Hz and 7000 Hz, a region over 
a predetermined frequency in the range between 
2000 Hz and 7000 Hz, or two regions of a region 
under a predetermined frequency in the range be- 
tween 1800 Hz and 7000 Hz and a region over a 
predetermined frequency in the range between 
2000 Hz and 7000 Hz, and the region attenuation 
process is performed to either one or a combination 
of more than two of said regions. 
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4. An auditory sense training method according to 
claim 1, wherein said region attenuation process is 
performed to a plurality of various frequencies, said 
frequencies and the processing time being set ran- 
domly and arranged in time order. 5 

5. An auditory sense training method for training au- 
ditory sense by having a sound of more than two 
channels formed by processing an original sound 
listened to: wherein 10 

a processed sound and a non-processed 
sound are listened to alternately by a trainee, said 
processed sound being performed of a process 
where an amplitude attenuation processed sound 
formed by attenuating an amplitude of the original is 
sound of one channel is outputted to one channel, 
and an amplitude attenuation processed sound 
formed by attenuating an amplitude of the original 
sound of one channel is superposed to the original 
sound of another channel and outputted to the other 20 
channel. 

6. An auditory sense training method according to 
claim 5, wherein said process is performed so that 

the sum of the amplitude attenuation processed 25 
sound being outputted to said one channel and the 
amplitude attenuation processed sound being out- 
putted to said other channel is fixed for one channel 
signal. 

30 

7. An auditory sense training method according to 
claim 6, wherein said process includes a plurality of 
various process patterns, said process patterns and 
the processing time being set randomly and ar- 
ranged in time order. 35 



original sound of one channel is outputted to one 
channel, and an amplitude attenuation processed 
sound formed by attenuating the amplitude of the 
original sound of one channel is superposed to the 
original sound of another channel and outputted to 
the other channel. 

11. A sound processing method for auditory sense 
training disclosed in claim 10, wherein the proc- 
essed sound performed of said process is outputted 
alternately with a sound not being performed of said 
process. 

12. A sound processing method for auditory sense 
training disclosed in claim 10, wherein said process 
characterizes in that the sum of said amplitude at- 
tenuation processed sound outputted to said one 
channel and said amplitude attenuation processed 
sound outputted to said other channel is fixed for 
one channel signal. 

13. A sound processing method for auditory sense 
training disclosed in claim 1 0, wherein said process 
is performed by a plurality of various process pat- 
terns, said process patterns and the processing 
time being set randomly and arranged in time order. 

14. A sound processing method for auditory sense 
training to be used in an auditory sense training 
method for training auditory sense by having a 
sound formed by processing an original sound lis- 
tened to: wherein 

a phase reverse process for reversing the 
phase of the original sound is performed to said 
original sound. 



8. An auditory sense training method for training au- 
ditory sense by having a sound formed by process- 
ing an original sound listened to: wherein 

said original sound and a phase reverse proc- 
essed sound formed by performing a phase reverse 
process to said original sound for roughly reversing 
the phase of the original sound are listened to alter- 
nately by said trainee. 

9. An auditory sense training method according to 
claim 8, wherein the processing time of said phase 
reverse process is set randomly and arranged in 
time order. 

10. A sound processing method for auditory sense 
training to be used in an auditory sense training 
method for training auditory sense by having a 
sound of more than two channels being formed by 
processing an original sound listened to: wherein ss 

said sound processing method includes a 
process where an amplitude attenuation processed 
sound formed by attenuating the amplitude of the 



15. A sound processing method for auditory sense 
training according to claim 1 4, wherein the process- 
ing time of said phase reverse process is set ran- 
domly. 



40 



45 



16 



EP 1 031 955 A1 




17 




18 



EP 1 031 955 A1 



CO 




19 



EP 1 031 955 A1 





-I 




I 



I 



CD 



2 



s 

§1 



00 

c c 

*S J 

O *g 

CD v-, 9 



2 




» 

* I— < 



00 



2 



00 

I I 

u 00 



i 

c 
o 
o 



2 




1 § 

S fa 



20 



EP 1 031 955 A1 



Fig. 5 



original sound 



fh2 



wo region attenuation 

fb 



20 

1 



low band attenuation 
fh 1 


^21-1 




• 
• 
• 



high band attenuation 

n 



22 



r~ 



21-3 



1 



selection 



T 



•21-4 



band attenuation 
processed sound 



band select 
control signal 



21 



EP 1 031 955 A1 



Fig . 6 



left channel 
input 



right channel 
input 



coefficient generation 
control signal 



100- a 



43 



1 00- g 



i 



generate 
coefficient 



I 



41 



variable 
attenuation 

LL 



T 



46 



& 



variable 
attenuation 

LR 



T 



42 



variable 
attenuation 
RL 



j 



44 



variable 
attenuation 

RR 



J 



47 



0 



45 



panpot process 



40 

left channel 
output 



right 
output 



22 



EP 1 031 955 A1 




EP 1 031 955 A1 



Fig. 8 



50 



phase reverse process 



left channel 
signal 



51 



phase 
reverse 



52 



selection 



right channel 
signal 



left channel 
signal 



right channel 
signal 



phase reverse control signal 



24 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

■ 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: . 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



